resnet50 vs swin transformer tiny Table

Zack_'s workspace

Runs

summary

Accuracy by class

Epoch

Epoch time

Total accuracy

Train loss

Val loss

Finished

zack_

4y ago

1h 40m 31s

128

0.0002

CrossEntropyLoss()

accuracy

Adam ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0002 weight_decay: 0 )

0 Total params 4.020358e+06 Trainable params 4.020358e+06 Non-trainable params 0.000000e+00 Input size (MB) 7.350000e+01 Forward/backward pass size (MB) 2.220981e+04 Params size (MB) 1.533645e+01 Estimated Total Size (MB) 2.229865e+04

[["plane",94.5],["car",98.3],["bird",96.3],["cat",90],["deer",96.1],["dog",95.1],["frog",98.7],["horse",97.3],["ship",98.9],["truck",97.1]]

3.05791

96.23

0.0068874

0.17164

Finished

zack_

4y ago

1h 3m 9s

128

0.0002

CrossEntropyLoss()

accuracy

Adam ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0002 weight_decay: 0 )

[["plane",95.2],["car",95.6],["bird",95.7],["cat",90.3],["deer",94],["dog",93.8],["frog",97.4],["horse",98.4],["ship",99.1],["truck",96.9]]

1.82704

95.64

0.0067655

0.19563

Crashed

zack_

4y ago

36m 44s

128

0.0002

CrossEntropyLoss()

accuracy

Adam ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0002 weight_decay: 0 )

0 Total params 9.108968e+06 Trainable params 9.108968e+06 Non-trainable params 0.000000e+00 Input size (MB) 7.350000e+01 Forward/backward pass size (MB) 1.310973e+04 Params size (MB) 3.474796e+01 Estimated Total Size (MB) 1.321797e+04

[["plane",95.4],["car",95.5],["bird",91.6],["cat",92.4],["deer",91.1],["dog",83.4],["frog",97.2],["horse",96.4],["ship",97.2],["truck",96.3]]

1.57583

93.65

0.013014

0.26281

Crashed

zack_

4y ago

6h 13m 10s

128

0.001

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 initial_lr: 0.001 lr: 0.001 weight_decay: 0.01 )

0 Total params 1.962465e+07 Trainable params 1.962465e+07 Non-trainable params 0.000000e+00 Input size (MB) 7.350000e+01 Forward/backward pass size (MB) 4.354626e+04 Params size (MB) 7.486210e+01 Estimated Total Size (MB) 4.369462e+04

[["plane",27],["car",35.4],["bird",13.8],["cat",10.4],["deer",9.7],["dog",42.9],["frog",37.2],["horse",18.4],["ship",36.6],["truck",41.1]]

18.8677

27.25

2.03535

2.01188

Crashed

zack_

4y ago

3h 5m 32s

128

0.0005

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 initial_lr: 0.0005 lr: 0.0005 weight_decay: 0.01 )

[["plane",19.9],["car",19.6],["bird",34.4],["cat",14.9],["deer",19],["dog",14],["frog",48.1],["horse",21.4],["ship",63.1],["truck",43.4]]

18.95333

29.78

1.77897

1.91

Crashed

zack_

4y ago

27m 8s

128

0.001

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 initial_lr: 0.001 lr: 0.001 weight_decay: 0.01 )

[["plane",38.1],["car",0.3],["bird",2],["cat",0],["deer",0],["dog",40.4],["frog",0],["horse",0.1],["ship",26.3],["truck",14.8]]

11.19466

12.2

2.19794

2.30486

Crashed

zack_

4y ago

41m 21s

128

0.02

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 initial_lr: 0.02 lr: 0.02 weight_decay: 0.01 )

[["plane",0],["car",0],["bird",0],["cat",0],["deer",0],["dog",0],["frog",0],["horse",0],["ship",100],["truck",0]]

11.17604

2.32243

2.30895

Crashed

zack_

4y ago

26m 10s

128

0.0005

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0005 weight_decay: 0.01 )

[["plane",53.7],["car",54.3],["bird",23.8],["cat",13],["deer",20.7],["dog",58.2],["frog",75.8],["horse",43],["ship",66.6],["truck",75.6]]

10.92153

48.47

1.38844

1.41679

Finished

zack_

4y ago

36s

128

0.0005

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0005 weight_decay: 0.01 )

Finished

zack_

4y ago

1m 29s

128

0.0005

CrossEntropyLoss()

accuracy

AdamW ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0005 weight_decay: 0.01 )

Crashed

zack_

4y ago

1h 37m 40s

128

0.0005

CrossEntropyLoss()

accuracy

SGD ( Parameter Group 0 dampening: 0 lr: 0.0005 momentum: 0.9 nesterov: False weight_decay: 0 )

0 Total params 2.750372e+07 Trainable params 2.750372e+07 Non-trainable params 0.000000e+00 Input size (MB) 7.350000e+01 Forward/backward pass size (MB) 3.238153e+04 Params size (MB) 1.049184e+02 Estimated Total Size (MB) 3.255995e+04

[["plane",97.7],["car",99.1],["bird",95.8],["cat",91.3],["deer",94.6],["dog",92.9],["frog",98.5],["horse",95.9],["ship",97.9],["truck",93.4]]

5.24923

95.71

0.10892

0.13722

Finished

zack_

4y ago

59m 38s

128

0.0005

CrossEntropyLoss()

accuracy

Adam ( Parameter Group 0 amsgrad: False betas: (0.9, 0.999) eps: 1e-08 lr: 0.0005 weight_decay: 0 )

0 Total params 2.352852e+07 Trainable params 2.352852e+07 Non-trainable params 0.000000e+00 Input size (MB) 7.350000e+01 Forward/backward pass size (MB) 3.667851e+04 Params size (MB) 8.975419e+01 Estimated Total Size (MB) 3.684176e+04

[["plane",92.8],["car",95.8],["bird",90],["cat",87.9],["deer",92.7],["dog",85.9],["frog",94.9],["horse",95.8],["ship",94],["truck",96.3]]

2.63902

92.61

0.030025

0.2996

1-12

of 12